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Introduction: Overview 


Chapter overview: introduction 
o 1. What is Artificial Intelligence? 
o 2. Al Past and Present 
ə 3. Rational Agents 
o 4. Environments and Problem Solving Methods 
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Heterogeneous Application Areas 


Al systems are used for very different tasks: 
@ controlling manufacturing plants 
detecting spam emails 
intra-logistic systems in warehouses 
giving shopping advice on the Internet 


o 

o 

o 

o playing board games 

e finding faults in logic circuits 
o 


How do we capture this diversity in a systematic framework 
emphasizing commonalities and differences? 
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How do we capture this diversity in a systematic framework 
emphasizing commonalities and differences? 


common metaphor: rational agents and their environments 


German: rationale Agenten, Umgebungen 
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Agents 


sensors 


percepts 
actions 


actuators 


e agent functions map sequences of observations to actions: 
f:Pr JA 
@ agent program: runs on physical architecture and computes f 


Examples: human, robot, web crawler, thermostat, OS scheduler 


German: Agenten, Agentenfunktion, Wahrnehmung, Aktion 
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Introducing: an Agent 


Agents 
00008000 


Vacuum Domain 


e observations: location and cleanness of current room: 
(a, clean), (a, dirty), (b, clean), (b, dirty) 
ə actions: left, right, suck, wait 
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Vacuum Agent 


a possible agent function: 


observation sequence action 
(a, clean) right 
(a, dirty) suck 
(b, clean) left 
(b, dirty) suck 
(a, clean), (b, clean) left 
n clean), (b, dirty) suck 
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Reflexive Agents 


Reflexive agents compute next action only based on 
last observation in sequence: 


@ very simple model 
@ very restricted 


@ corresponds to Mealy automaton (a kind of DFA) 
with only 1 state 


@ practical examples? 


German: reflexiver Agent 


Example (A Reflexive Vacuum Agent) 


def reflex-vacuum-agent(location, status): 
if status = dirty: return suck 

else if location = a: return right 
else if location = b: return left 
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Evaluating Agent Functions 


What is the right agent function? 


Rationality 
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Rationality 


Rational Behavior 
Evaluate behavior of agents with performance measure 
(related terms: utility, cost). 
perfect rationality: 
ə always select an action maximizing 
ə expected value of future performance 


ə given available information (observations so far) 


German: Performance-Mass, Nutzen, Kosten, perfekte Rationalität 
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Is Our Agent Perfectly Rational? 


Question: Is the reflexive vacuum agent 
of the example perfectly rational? 
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Is Our Agent Perfectly Rational? 


Question: Is the reflexive vacuum agent 

of the example perfectly rational? 

depends on performance measure and environment! 
o Do actions reliably have the desired effect? 
o Do we know the initial situation? 


ə Can new dirt be produced while the agent is acting? 
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Rational Vacuum Agent 


Example (Vacuum Agent) 
performance measure: 
ə +100 units for each cleaned cell 
e —10 units for each suck action 


e —1 units for each left/right action 


environment: 
e actions and observations reliable 
e world only changes through actions of the agent 


e all initial situations equally probable 


How should a perfect agent behave? 
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Rationality: Discussion 


e perfect rationality 4 omniscience 


o incomplete information (due to limited observations) 
reduces achievable utility 


e perfect rationality 4 perfect prediction of future 


e uncertain behavior of environment (e.g., stochastic 
action effects) reduces achievable utility 


e perfect rationality is rarely achievable 
e limited computational power => bounded rationality 


German: begrenzte Rationalität 
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Summary (1) 


common metaphor for Al systems: rational agents 


agent interacts with environment: 
@ sensors perceive observations about state of the environment 
e actuators perform actions modifying the environment 


ə formally: agent function maps observation sequences 
to actions 


ə reflexive agent: agent function only based on 
last observation 
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Summary (2) 


rational agents: 
e try to maximize performance measure (utility) 
o perfect rationality: achieve maximal utility in expectation 
given available information 
ə for “interesting” problems rarely achievable 
~> bounded rationality 


